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ABSTRACT 

Present composition teaching and testing techniques 
do not formally capture student imt)rovement across essays. Contract 
learning, a procedure in which student essays are error-analyzed 
repeated mistakes, can do so. Correction of those repetitions 
a set of goals on a written contract signed by the teacher and 
studeft=t, and the student works to accomplish the goals by the 
the term. Contract fulfillment, may involve either remediation 
self-motivation. Fulfillment is based on a slowing, stoppage, 
reversal of error trends by the term's end. Contract results proyip 
a new, individualized, criterion-referenced source of measurement 
information to be integrated with other criterion-referenced (task 
based) and norm-referenced (rank based) sources in an advancement 
decision using multiple references. Examples are given of this 
technique, based on 2 years of experience with the cmtract learning 
procedure. (Author/MSE) 
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ABSTRACT 

Present composition teaching/testiny techniques do not 
formally capture student improvement across essays- Con- 
tract learning (after Parkhurst, 19 22) can do so. It is a 
t^rocedure where student essays are error anal/zed for re- 
peated mistakes, those repetitions become goals on a writteji 
contract signed by the teacher and student, and the student 
«orts to reaove those difficulties by the end of the term. 
Contract fulfillment may involve remediation and/or may be 
selE- motivated. Fulfillment is judged based on a slowing, 
stoppage, or reversal of error trends by the end of the 
term, contract results provide a new, individualized., 
self -criterion referenced source of measurement inf orma tion.- 
That source can be integrated with criterion- referenced 
(task based) and" norm referenced (rank based) sources in a 
multiply referenced advancement decision. Examples are giv- 
en this paper of just such an iutegratiou : the data for 
the examples follow two years of experience w^^th the con- 
tract learning procedure. 
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1. IHTBODOCTIOS 

This paper ^jroposes a yeaeral frameworlt fox improvement 
of lonjitudiaal ESL comi.iosition teaching aud testiay. Im- 
plicit in the £olloHing arguments is the acknowledgement 
that present composition measures do not show ongoing im- 
provement characteristics of an ESL composition student. A 
tad=her vho uses a single-shot measure, for example a score 
on an essay's ^^al draft, captures necessary information 
but may miss the process behind that essay* s production; 
this is a complaint often heard among composition special- 
ists who support the study of process rather tJian product. 
The procedure described in this paper goes a step further. 
Not only is study of the single-essay process necessary, but 
also worthy of attention is the longitudinal improvement 
profile a student exhibits across many essays and many top- 
ics. This paper offers a procedure to do spz cojit£act 
1 earning . 

In so doing, it will become evident that such a procedure 
does not fit neatly with any current measureaent option. 
Multiple refer enci ng is a framework in which the longitudi- 
nal contract procedure may be integrated with other mea- 
sures, be they of process, or of product. In addition to 
arguing for contract learning, this 'paper argues for the 
formalization of multiple referencing as a means of utiliz- 
ing the unique information contracts provide, in conjunction 
with whatever measurement techniques a teacher may already 
employ. 

- 3 - 4 



2- BiCKGHOOHD: THE IHDI7ID0AL li THIS ESL 

CLASSBOOB 

Contract learning is useful as a longitudinal teaching/ 
testing technicjue because It can accomodate two features 
composition impirovement. These tuo features emerge only 
when one studies a student's imnprovemant prpfile across 
many essays. 

Before descrihing those features, a dafinitipn is ia ord- 
er. A learning contract is a written agreeaeni: which the 
student and teacher sign. It specifies the goals the stu- 
dent should achieve within a stated time period, and de- 
scribes the "payaenf for fulfillment, which need be no more 
than a desirable grade. (For the beginning of tte contract 
learning literature, see Parkhurst, 1922; for an o^ervieii of 
types of contracts, see Berte, 1975.) Contract learning is 
not a panacea for all of the ills of ESL compos^liion, but x± 
is especially helpful when one considers the features of ESL . 
composition skill development that are only evident across 
many essays. 

That trans-essay domain exhibits two striking features, 
each suited to contract learning. The first is interstudent 
differences in rate of improvement. Refinement of writing 
skills is a recursive, nonlinear phenomenon.* Success is of- 
ten matched by shortfall. Hith a flexible goal- communicat- 
ing device such as ^ contract, the success rate difference 



♦Recursiveness in ESL attainment is a central tenet of a 
{jowerful current theoretical framework: Monitor Theory and 
the Input Hypothesis (see Kr ashen, 1983 J . 
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between students can be accomodated. Contract xeiieyotia tion 
can i.^erttit a student to strive for attainment many times- 
In this aut^hor's experience with learning contracts, rarely 
were two students at the same point in contract fulfillment 
at day -given time, and rarely did students have the same 
number of contract renegotiations- 

::ontraet learning addresses a second feature of longitu- 
dinal ESL composition skill development: intexstudent dif- 
ferences in particular skill areas needing attention. For 
one student a cfc>rtain subskill may be problematic while for 
another it is not- Such differences can be Studied under 
the theoretical framework of Error Analysis (c-f- Cord- 
er,1967; Hemser,1971; Selinker, 1972). Error Analysis is an 
approach to determine the significance of learner linguistic 
dev2lopmental difficulties. It states that skill areas most 
worthy of pedagogical attention are those delineated by a 
repaating pattern of accumulated difficulties. In couLcact 
learning, repeated mistakes taken from a student's writing 
can be set before the student as contract goals to be ful- 
filled-* These two longitudinal features adressed by con- 
tract learning imply that a contract is both a teaching and 
a tasting tecbniqae, and that it is individualized. It 

*It should be noted that the term "mistake" is being used in 
a very broad sense. Furthermore, this application of Error 
Analysis is not meant be a negative motivator, i.e. overem- 
phasis on mistakes is of course not desirable. In the con- 
tract system, this autho^r has found that not to be the case, 
since (1) contracts are Taut one component of a larger class, 
and (2) students may want to focus their attention on their 
ffiistaXes. 



tua::ht)ti (1) via clear cuinuiunica ti^u butwean teacher and stu- 
dent and (2) by frovidiuy taliatiika °^ ^^e clasa to the 
nee;ls af the . individual. It tests by offeriny a self yenor- 
dted criterion against which attainment can be checlced: the 
irepeated difficulties. In current testing literature, con- 
trast learning Mould appear to be.-cr iterion referenced, for 
it measures against a task rather than agai st a rank (vhich 
i^ known as nora referencing. For a comparison of nora and 
criterion referencing see Pophaa 1978.) 

However, contract learning is not strictly crxterioa re- 
ferenced, and that claia points out the need for th:e auiii" 
ple refarencing framework menti'^aed earlier. Contract 
learning of.y or may not involve sioilar task goals for all 
class meabers. ' It the saae contract goal were put before 
all 5.tudents p a class, then it would indeed be a criterion 
referenced aeusij-x^oe it technique. But if, as has been this 
author's v-xperie^ce, goals vary drastically across students, 
contract learning is aore pjroperly sgHrSltilaCioa. 
enced- self- criterion referencing (SCR) aay be defined as 
ireasureaent against a task derived from the needs profile of 
a single' student- As such it is a non-group information 
source to be balanced against a group- task source (criterion 
referencing- -CH) , and a group-rank source (norm referenc- 
ing— NH) , when the teacher makes an advancement decision. 
That balancing is the act of mulUple referencing. Haltiplc 
• referencing may be defined as the utilization of all sources 



of inoaauctsiaont iuCocina tion that iinjinyu on a atudont'a ad- 
vanoeraaut. Fivj-uce 1 diaycums nultiplo rufQr0nGiny; it in- 
cludaa the three raeaauremon t iafocmation sources mentioned 
above and dQ^iiowl.3dijea the existence of other sources (the 
definition of which this autiior is pursuing is current re- 
searchj : 



MB 
II 

iniiiii 
I I I 1 
1 i I I 
1111 

NH CR SCR OTHER 
FIGURE 1 : 

rhe Multiple Referencing Heasureaent FrameworJt* * 

Since contract learning does not properly fit in with either 
CR or NR, a new superordinate measurement infoxaation cate- 
gory is needed: aultiple referencing. 



*It may be more appropriate to . subclassif y CR iAto GROUP C3 
and SCR, as suggested by Brian Lynch (personal cpaaunica- 
tion) . However^ this diagram does not represent HR and CR 
as they are usually differentiated in testing literature: as 
conditions on score interpretation. Rather, it gives the 
sources of nea aurenent available to the teacher. It xs a 
diagram of sources, not interpretations- 



rha iiaxt o«ct4.on outlineti a nmltiidy rafereuced applioA- 
tion of contract loacnincj In ESI. cooijositiou claaaaa- 

3. APPLICATIOI 

3.1 NllflfiS 

3ver the past two years, this author has used contract 
learning as an iateyral part of six EBL conposition classes. 
Each class was university or pre-university ESL- Each «as a 
heterogeneous group with aixed success rates and varying 
needs, the tMo features described above- Contract learning 
never formed the entire course; however, it always had a 
substantive role. Lectures and discussions on ESL composi- 
tion skills, use of exemplar analysis^ inductive question- 
ing — all were aethods compleaented by contract learjiing- 

In each course, the actual contract goalSt, were determined 

/' 

froa error analytic counts on the students' writing. A sin- 
gle contract for a single student is shown in Figure 2; the 
goals are hypothetical, but they represent frequently ob- 
served student profile s« 



Leaunincj Contract 



I 
I 

I unaacatanil that the follow in^j points l\ave liaofl' Idyntl- 
tiacl as ueeda in coiopoaitiona. I further uaduratand 
that if I elininate thaao difficulties by thejeud of tho 
tern, thtin I will have fulfilled a aajor yoal of this 
course: self-guided writing inprovaaent. 



Contract Goads: 

1. use of indentation 

2. specificity of supports for the aain idea 

3. use of articles 

4. spelling 

5. efficiency: use of tiae while writing 
6. 

7. 

signed^ 

(student) (date) 
witnessed, 
(teacher) (date) 
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Figure 2: Saople Contract 
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stmlunta couia, and diU aitfai.- in tlia nuntjef ot. L-«uaijut'. l.i- 
tloiia, and thw aiJaai£iG yoala conturtGtkjd. In <t<idition, coii- 
ttuQt ijccila di£focod aacoaa court^ws 4S ix t,'Q£l»3cUou of Hyi- 
labuii cauu^jQa, ha much aa powaible tho Ecroc Annlyyia 
GouHtiny waa done by tht|sj#tudQuta, in an effoct to coduco 
teuahat workload; thla ^Jt'oved to bo a aotivaltny I'actoi: of 
individual studont roapbnaibili ty- In yanural, tii« con tract 
pcocedure went aa follows: (1) the taa'chei: would nark the 
easaya with aome sort of error coda ayataa, (2) the atudont 
would keep a couat of cetjeated aynbola, and (J) those re- 
peated symbols would becoae the contract goala which the 
student would work to eliminate. The numbiar of essays prior 
to the first con^tract varied from class to class, ba-t always 
sought to identify true trends in student needs- Roughly., 
in a term with 12-16 essays, 1/4 to 1/3 were writtea before 
the first contract. 

Remediation occured via three avenues. first, although 
contract learnijQ,g permits individual tailoring to capture 
student success rate and need differences, some agreement 
usually existed across class members, with respedt to actual 
contracted goals* For example^ a certain grammar point 
migtt have been problematic in the writing of many students. 
Thus remediatian was often possible through actual class 
lessons on sl^ared contract goals* Second, remediation was 
offered via individual teacher guidance written on essays or 
renegotiated contracts^ or in private conferences. Dlti-- 

- 10 - 11 



«yiitotlu«s4 ijivon (\ oi^rti: iaenfcitia^tion at: nweil*^, ^jiv^n 4i 
cuuttagt, uivun 4 woiUcuin u£ aU^m oi: kuficUuc htilf, iwiJcavtj- 
iiiuat oCtea cewuLted from outaiae Moth.. In auoi* f* aase, th« 

;:oi\tcttct fulfilloout waa Judij«d bua^a on cavQcaAl o| 
ttenaa* ReyatdXeaa of tha nuabei: of coaeyoUatiofia, all 
contcacta and easaya wace tucned in at tJie and o£ the tera- 
The teacher would than study aach student » a cpntract, ©a- 
says, and if eaployed, ecroc count. If a definite alowing, 
stoppage, oc revecaal had ocpurrad on a give© yoa.1, that 
goal was labeled "fulfilled." 

3.2 mAI£fiaMI DS£IS£SI 

Fulfilled coatxact points, wore then used as one inforaa- 
tion source in a aultiply referenced end-of-i'tora advanceaent 
decision. This section describes how that was done- 

Pirst, however, it is necessary to reenphasize the indi- 
vidualizatiop of the contract learning systea. It would be 
soaawhat aisleading, to include a "results" discussion here, 
which focused on the average nuaber of fulfilled vs. con- 
tracted points in classes using this systea* Syllabus 
changes across terms aeant that the wording of contract goal 
points often differed across applications. Iha± is, for one 
class a particular . goal aight be phrased ^differently than 
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for anpthec, or it aay be suhsuaed under another goal, or it 
may be absent entirely. Thus it is not possible to study 
the domain of composition stills based on contract data re- 
sults because the system was individualized to the. needs of 
particular individuals in particular classes. Instead, this 
section describes the use of contract results as an addi- 
tional source of information impinging on the advancement 
decision: a multiple referencing decision activity- 
Consider the data in Table 1. This is hypathetical in- 
formation about contract fulfillments based on experience 
with this system in six ESL classes- 
Student 1 G1 (G2) (G3) (G4) G5 ^ G9 Gil G 13 
Student 2 (G2) GJ* G5 (G8) 
Student 3 (G1) G5 (GlO) Gil 

Table 15 Hypothetical Contract Pulfillmenli Data, 
for three students in one ESL composition class: 
G1^ G2, ..I* Gn represent contracted goals, and 
parentheses indicate fulfillment. 

Bote the fulfilled goals in parentheses. Imagine that G2 
repi;e^its the correct use of the past perfebt. The par- 
entheses indicate that tao of the three students experienced 
difficulty with that composition subskill, but that by the 
end of the terjtt that difficulty had slowed noticabli, stop- 
ped, or reversed (i-e. superior use of that fprm) . Other 
goals in parentheses may be intrepreted similarly- Goals 
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not in parentheses represent unfulf illel points; the/ ace 
stiLl evident as difficulties by the end of the tera. For 
an example of an unfulfilled point, note G5- 

3onsider further student 3. Imagine that at the end of 
the tera her final exam cob position score places her at the 
top of the class. In addition, imagine that she had consis- 
tently demonstrated mastery of a majority of the ob.Jectives 
represented by several criterion referenced short quizzes. 
Although some o£ her unfulfilled needs may be critical at. 
the next level of ESL (e.g. G5) , do they mean she should not 
Le advanced? 

Consider also student 1- Imagine that at tJie ei^d of the 
term he placed at the class meaa on that final composition 
exam. At the beginning of the term he placed at the bottom 
of the class on. a norm-referenced diagnostic iaJte-home es- 
say. The teachetr sensed that he would be a challenge. Hote 
that less than 1/2 of his contract points appear fulfilled. 
What is to be done? Consider adding in the foliOHing infor- 
mations is half a contract indicative of an improvement 
curve that Mill continue into the next ESL leveJi? How cri- 
tical are those points he fulfilled versus those he did not? 
Hith respect to norm referenced information, is a score at 
the class mean usually sufficient evidence for advancement? 
Was this a particularly high or low class, and if either, 
does thatchange the interpretation of the mean? Consider- 
ing the criterion-referenced information, does his perfoc- 

- 13 - 14 . 



maa::e on quizzes indiccite mastery of objectives? Bere his 
contract points worded in such a way to link to those objec- 
tives (i.e. link CB and SCR), and indicate mastery or non- 
mastery?* The claim here is that running such a series of 
questions throoyh one's mind is the decision activity of 
multii^le referencing. That activity is oAe that teachers 
enyaye in intuitiveiy, ^ it is not formalize^ in m^aailS.- 
aent systems which rgix ^aJCiiJt 2a ^ test. 

4« CQHCLOSIOH: SOHHIHI AID IHPLICITIOIS 

rhis paper doe^s not argae a specific coarse of advance- 
ment action for Students 1 and 3. Further, any action about 
student 2 is left to the reader's iaagination- 

aather, this paper's focus is tke raw concept of contract 
learniny. Experience with this system has conviiiced the au- 
thor that its application in individual cases will vary 
yreatly, with^ respect to the force it has in the multipl]^ 
referenced advancement decision. Independent of any specif- 
ic application, the advantages of contract learning still 
appear strong. This procedure addresses a measurement 
source that is not formally tapped by any other instrumenta- 
tion, namely individualized attainment. As such, contract 
learning demonstrates the need for the multiple referencing 

7 

consider inf or«a.tion outside the HH-CB-SCR optipns: What is 
the next ESL level, if any? What is his majpr, and what 
does his major imply regarding a composition load?— such 
Questions as these might be the type of considerations under 
"Other" in Figure 1, a classification this author's research 
is sarrently pursuing- 



decision activity outlined above- 
In addition, contract learning addresses four ch:aracter- 
istics of ESL compositon teachin^j and testing: ,(1) interstu- 
dent differences in success rate and needs can he accomodat- 
ed, (2) the potential for alf motivated leaxaing is high, 

(3) there is a need for multiply referenced aeasureaent in- 
formation sources, and as will be described in detail below*, 

(4) SCfi data imply some new information foe future research. 
SCH data is a new multi-studeat source of loncpLtadinal 

information. Across several academic terms,, self- topping of 
the idiosyncratic, recursive, nonlinear development toward 
fluency could be charted on a sort -SCH Performance Charts 
Performance chart data could proviu . an outside validity 
check on norm and criterion referenced data, which in turn 
could validate SCfl. Perhaps "other" (c-f. Figure 1) infor- 
mation sources such as ratings could also be cross-checked- 
In addition, long-term SCB charting could be a source of 
cross- validation for second language research studies nor- 
mally carrried out longitudinally on a small number of sub- 
jects. That validation would have as a data base a formal- 
ized SSL measurement system (SCB Performance Charts) on many 
students, across many terms, utilized by many teachers. 
Last, experience with contract learning indicates a further 
value of long term SCR mapping: students take an interest 
in their progress; to a la rge extent the £g?P9ftg4feillfci: Sf 
recard keeping can be left in i^heir liands. This %mplies 



that the motivational self teachiny value of SCR mapping 
systems (such as contract learning) could be felt across 
many terms. »hj not give students a stake iu their own in- 
terlanguage future? Why not let them map their own develop- 
ment?* 

perhaps the simplest argument in favor of contract learn- 
ing is one this author has already experienced, and de- 
scril^ed above. A contract is a neji source o£ m^^sug^m^n fe 
information . Its use forces the teacher to formalize the 
multiple referencing advancement decision process. This is 
a process that intuitively should, and does, occur; however, 
it needs to be formally acknonledged in ESL teaching systems 
whece advancement is based largely on test results.** 



♦ This is over and above the "Honitor" that Krashen 1-1983 and 
elsewhere) describes. Tes, in contract learning a student 
does indeed monitor his/her improvement; xn addition, the 
student measures that improvement. In the second sense, 
such a responsihility is not "monitoring" as Krashen and 

others have used the term. t^- i^ „ 

♦*IESOL has begun to acknowledge the need for multiple in- 
formation sourSes- In its statement on competency testing 
(TESOL 1979), it advises multiple measura men t because the 
compleiity of competency assessment demands tha-t a student 
be given many opportunities to demonstrate mastery. As John 
oiler (personal communication) has suggested, perhaps we 
need a more broadly based professional acknowledgement of 
the multiple measurement information sourses that impinge on 
an advancement decision. 
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